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Amendment dated June 2, 2009 

In Response to Office Action mailed March 6, 2009 

Amendments to the Claims 

This listing of claims will replace all prior versions and listings of claims in the application. 

1. (Cancelled) 

2. (Currently Amended) The method of claim 4- 19, wherein receiving the video signals 
comprises: 

receiving video images of lip movements that coincide with the audio signals. 

3. (Currently Amended) The method of claim 4- 1_9, wherein processing comprises: 
proc e ssing the audio signals and the video signals are processed in parallel, the video 

signals coinciding with the audio signals. 

4. (Currently Amended) The method of claim 4- 19, comprising: 
storing the audio signals and the video signals; and 

sending the audio signals and the video signals to a destination source. 

5. (Cancelled) 

6. (Currently Amended) The speech recognition device of claim & 20, wherein the video 
signal receiver is configured to receive video images of lip movements that coincide with the 
audio signals. 

7. (Currently Amended) The speech recognition device of claim & 20, wherein the 
processing unit is configured to process the audio signals and the video signals in parallel, and 
wherein the video signals coincide with the audio signals. 



Page 2 of 10 



U.S. Application No. 10/660,780, filed September 12, 2003 
Attorney Docket No. 20220US02 
Amendment dated June 2, 2009 

In Response to Office Action mailed March 6, 2009 



8. (Currently Amended) The speech recognition device of claim & 20, comprises: 
a storage unit for storing the audio signals and the video signals; and 

a transmitter for sending the audio signals and the video signals to a destination source. 

9. (Cancelled) 

10. (Currently Amended) The system of claim 9 21, wherein the second receiving 
means receiver receives video images of lip movements that coincide with the audio signals. 

1 1 . (Currently Amended) The system of claim 9 21_, wherein the proc e ssing m e ans 
processor processes the audio signals and the video signals in parallel, and wherein the video 
signals coincide with the audio signals. 

12. (Currently Amended) The system of claim 9 21, comprises: 

a storage means for storing device that stores the audio signals and the video signals; and 
a transmission means for sending transmitter that transmits the audio signals and the 
video signals to a destination source. 

Claims 13-18 (Cancelled). 

19. (Previously Presented) A method of speech recognition, comprising: 
determining if video images of a speech source are detected; 
indicating if the video images are not detected; 
receiving audio signals from the speech source; 
receiving video signals from the speech source; 
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detecting if the audio signals can be processed; 

processing the audio signals if it is detected that the audio signals can be processed; 
processing the video signals based on a detection that at least a portion of the audio signal 
cannot be processed; 

converting at least one of the audio signals and the video signals into recognizable 
information; and 

implementing a task based on the recognizable information. 

20. (Previously Presented) A speech recognition device, comprising: 

an audio signal receiver configured to receive audio signals from a speech source; 

a video signal receiver configured to receive video signals from the speech source; 

a processing unit configured to detect if the audio signals can be processed and if so, to 
process the audio signals and process the video signals based on the detection that at least a 
portion of the audio signals cannot be processed; 

a conversion unit configured to convert at lease one of the audio signals and the video 
signals to recognizable information; and 

an implementation unit configured to implement a task based on the recognizable 
information, 

wherein the processing unit is configured to determine if the video image of a user is 
detected and, if the video image of the user is not detected, to indicate to the user that the video 
image is not detected. 

21 . (Previously Presented) A system for speech recognition, comprising: 
a first receiver that receives audio signals from a speech source; 

a second receiver that receives video signals from the speech source; 
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a processor that detects if the audio signals can be processed and that processes the audio 
signals if the audio signals can be processed, the processor processing the video signals based on 
the detection that at least a portion of the audio signals can not be processed; 

a converter that converts at least one of the audio signals and the video signals to 
recognizable information; and 

an implementor that implements a task based on the recognizable information, 

wherein the processor determines if the video image of a user is detected and, if the 
user's video image is not detected, indicates to the user that the video image is not detected. 

22. (Currently Amended) The method of claim 4- 19, wherein at least the receiving of 
the audio signals and the receiving of the video signals occurs in a mobile phone. 

23. (Currently Amended) The method of claim 4- 19, wherein at least the receiving of 
the audio signals and the receiving of the video signals occurs in a laptop computer, a home 
computer, a remote controller and/or a game console. 

24. (Cancelled) 

25. (Cancelled) 

26. (Previously Presented) The system of claim 21, wherein the system for speech 
recognition is part of a mobile phone. 

27. (Previously Presented) The system of claim 21, wherein the system for speech 
recognition is part of a laptop computer, a home computer, a remote controller and/or a game 
console. 



Page 5 of 10 



U.S. Application No. 10/660,780, filed September 12, 2003 
Attorney Docket No. 20220US02 
Amendment dated June 2, 2009 

In Response to Office Action mailed March 6, 2009 

28. (New) The method of claim 19, wherein the method occurs in a mobile phone. 

29. (New) The method of claim 28, wherein the mobile phone comprises a lens and a 
display. 

30. (New) The speech recognition device of claim 20, wherein the speech recognition 
device is part of a mobile phone. 

31. (New) The speech recognition device of claim 30, wherein the mobile phone 
comprises a lens and a display. 

32. (New) The system of claim 26, wherein the mobile phone comprises a lens and a 
display. 

33. (New) The method of claim 19, wherein the method occurs a laptop computer, a 
home computer, a PDA, an audio/video recording device, a remote controller and/or a game 
console. 

34. (New) The speech recognition device of claim 20, wherein the speech recognition 
device is part of a laptop computer, a home computer, a PDA, an audio/video recording device, a 
remote controller and/or a game console. 

35. (New) The method of claim 28, wherein the method is part of a voice activated e- 
mail application. 
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36. (New) The speech recognition device of claim 30, wherein the speech recognition 
device is used with a voice activated e-mail application. 

37. (New) The system of claim 26, wherein the system for speech recognition is used 
with a voice activated e-mail application. 

38. (New) The method of claim 28, wherein the recognizable information comprises one 
or more numeric characters. 

39. (New) The method of claim 28, wherein the recognizable information comprises 
code that is used to perform a particular function. 

40. (New) The speech recognition device of claim 30, wherein the recognizable 
information comprises one or more numeric characters. 

41. (New) The speech recognition device of claim 30, wherein the recognizable 
information comprises code that is used to perform a particular function. 

42. (New) The system of claim 26, wherein the recognizable information comprises one 
or more numeric characters. 

43. (New) The system of claim 26, wherein the recognizable information comprises 
code that is used to perform a particular function. 

44. (New) The speech recognition device of claim 30, wherein at least the processing 
unit, the conversion unit and the implementation unit are integrated on a single chip. 
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45. (New) The system of claim 26, wherein at least the processor, the converter and the 
implementor are integrated on a single chip. 

46. (New) The speech recognition device of claim 20, wherein the recognizable 
information comprises at least one of text and one or more executable commands. 

47. (New) The speech recognition device of claim 30, wherein the recognizable 
information comprises at least one of text and one or more executable commands. 

48. (New) The system of claim 21, wherein the recognizable information comprises at 
least one of text and one or more executable commands. 

49. (New) The system of claim 26, wherein the recognizable information comprises at 
least one of text and one or more executable commands. 

50. (New) The method of claim 19, wherein the recognizable information comprises at 
least one of text and one or more executable commands. 

51. (New) The method of claim 28, wherein the recognizable information comprises at 
least one of text and one or more executable commands. 
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